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Abstract 

Assume that 

Au = f, (1) 

O , 

is a solvable linear equation in a Hilbert space, \\A\\ < oo, and R(A) is not closed, 
so problem (1) is ill-posed. Here R(A) is the range of the linear operator A. A DSM 
(dynamical systems method) for solving (1), consists of solving the following Cauchy 
rfl ' problem: 

u = -u+ {B + t{t)Y l A*f, m(0) = Wo, (2) 



where B := A* A, u := %, Uq is arbitrary, and e(t) > is a continuously differentiable 
function, monotonically decaying to zero as t — > oo. A.G. Ramm has proved that, for 
any uq, problem (2) has a unique solution for all t > 0, there exists y := w(oo) := 
lim^oo u(t), Ay = f, and y is the unique minimal-norm solution to (1). If f$ is given, 
such that ||/ — fs\\ < 5, then Ug(t) is defined as the solution to (2) with / replaced 
by fs- The stopping time is defined as a number tg such that lim^o H^a^a) ~ y\\ — 0, 
and lim^o^ = oo. A discrepancy principle is proposed and proved in this paper. This 
principle yields t$ as the unique solution to the equation: 

\\A(B + e(t))- 1 A*f s -f s \\=6, (3) 

where it is assumed that \\fs\\ > 8 and fg _L N(A*). For nonlinear monotone A a 
discrepancy principle is formulated and justified. 



1 



1 Introduction and statement of the result. 



Assume that 

Au = f, (1.1) 

is a solvable linear equation in a Hilbert space, \\A\\ < oo, and R(A) is not closed, so 
problem (1.1) is ill-posed. Here R(A) is the range of the linear operator A. Without loss 
of generality, assume that \\A\\ < 1. Let y be the unique minimal-norm solution to (1.1). 
A solvable equation (1.1) is equivalent to 

Bu = A*f, B := A* A, (1.2) 

where A* is the operator adjoint to A. One has N(B) = N(A) := N := {v : Av = 0}. 
Let Q := AA*, and a > be a number. Then ||£|| < 1, \\Q\ \ < 1, and (B + a) _1 A* = 
A*(Q + a) -1 , as one easily checks. Denote by E\ and F\ the resolutions of the identity 
of B and Q, respectively. 

Let e(t) be a monotone, decreasing function, 

e(f) > 0, lime(t) = 0, lim sup |e(s)|e~ 2 (t) = 0. 

A DSM (dynamical systems method) for solving (1.1), consists of solving the following 
Cauchy problem: 

du 

u = -u + (B + e{t))- 1 A*f, «(0)=«o, u:=—, (1.3) 

where w is arbitrary, and proving that, for any u , problem (1.3) has a unique solution 
for all t > 0, there exists y := -u(oo) := lim t ^ 00 -u(t), Ay = /, and y is the unique 
minimal- norm solution to (1.1). These results are proved in [3]. If fg is given, such 
that |]/ — fs\\ < 5, then us(t) is defined as the solution to (1.3) with / replaced by fg. 
The stopping time is defined as a number ts such that lim^o H^tj) ~ y\\ = 0, and 
rim,5_ > ot5 = oo. A discrepancy principle for choosing ts is proposed and proved in this 
paper. 

Let us assume fs _L N(A*). Then this discrepancy principle, yields ts as the unique 
solution to the equation: 

\\A(B + e(t))- 1 A*fs-fs\\ = 5, \\fs\\>5, (1.4) 

and we prove that 

lim \\us(ts) — y\\ = 0, lims^ots = oo. (1.5) 

S— >0 

Thus, our basic result is: 

Theorem 1.1. If A is a bounded linear operator in a Hilbert space H , equation (1.1) 
is solvable, \\fs\\ > 5, fs -L N(A*), and e(t) satisfies the assumptions stated above, then 
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equation (1-4) has a unique solution t$, and (1.5) holds, where y is the unique minimal- 
norm solution to (1.1). 

In Section 2 a proof of this theorem is given, and a discrepancy principle is proved 
for equation (1.1) with monotone, nonlinear, continuous operator A. For variational 
regularization the discrepancy principle was proposed by Morozov [2], see also [1] and 
[4]. In [5] a general regularization method is proposed for a wide class of nonlinear 
ill-posed problems. 

2 Proofs. 

First, let us prove two lemmas. By — ^ and — > we denote the weak and strong convergence 
in H, respectively. 

Lemma 1. If w n y, and limsup^^ ||u> n || < ||y||, then w n —> y. 

Lemma 2. If e(t) > 0, e < 0, and lim^oo e(t)e~ 2 (t) = 0, then lim^oo e~*e _1 (i) = 0. 

Proof of Lemma 1. If w n — y, then \\y\\ < liminf n _ >0O ||u> n ||. This, and the 
inequality limsup„_ KXJ || w n \ \ < \\y\\ yield lim n ^oo \\w n \ \ = \ \y\\. Thus, lim^oo | \w n -y\ \ 2 = 
lim n _ +00 [|K|| 2 + \\y\\ 2 -2^(w n ,y)} = 0. □ 

Proof of Lemma 2. Our assumptions imply de dt ^ < c, where c = const > 0. Thus 
e _1 (t) < ct + Co, where Co > is a constant. The conclusion of Lemma 2 follows. □ 

Remark 1. An example of e(t), satisfying all the assumptions imposed in the Intro- 
duction, is e(t) = Ci(c + t)~ b , where c , C\ > are positive constants, and b G (0, 1) is a 
constant. 

The proof of Theorem 1.1 consists of two steps. 

Step 1: prove that (1.4) has a unique solution ts, and lim^ots = oo. 

Step 2: prove (1.5). 

Step 1. Write e for e(t) and rewrite (1.4) as: 

S 2 = \\A(B + e)- l A*f & - fs\\ 2 = \\[Q(Q + e)~ l - I]f 5 \\ 2 = 

= e 2 [ (e + \)- 2 dp(\) := h(5,e). (2.1) 
Jo 

Here Q = AA\ p = (F x f s ,f s ), \\Q\\ < 1. One has h(oo,5) = ft dp = \\f s \\ 2 > 5 2 , and 
lim e ^ h(e, 5) = 0, by the dominant convergence theorem, provided that lim 7 ^ dp = 0. 
The last relation holds if fs -L N(A*) = N(Q). This assumption is natural, because f$ 
enters under the sign of A* in the definition of ws{s) in the argument given in Step 2. 
Thus, h(5, oo) > 5 2 and h(S, 0) = < 5 2 . By the continuity of h as a function of e one 
concludes that there exists a solution e :— g{8) > to the equation h(S, e) = 5 2 . Since h 
is a monotone increasing function of e, this solution is unique. Because e(t) is monotone 
decreasing, the equation e(t) = g(5) defines a unique root ts, and lim^o^ = oo. Step 1 
is done. 

Step 2. To prove (1.5), write ug(t) = UQe~ l + J* e~^~ s ^ws(s)ds, where here and below 
t := t$ is defined in Step 1, and ws(s) := (B + e(s))~ 1 A*f 5 . Because fs enters under the 
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sign of A*, one may assume that fg -L N(A*) = N(Q). This assumption has been used 
in Step 1. 

We have u$ = ji+j, where j 1 := -u e"*+ f^ 2 e~^~ s ^ws(s)ds, and j := J** e^^^ws^ds. 
One has ||w,s(s)| < ||/<5||e _1 (s), because \ \A*\ \ < 1, and ||(i? + e) _1 || < e _1 . By Lemma 2, 

I |.7i|| < ||«o||e -t + e~* / V 1 (£/2)||/ (5 || -> as i -> oo. 

Furthermore, 

lb'-!/|| < IK(t) / e-('- s )rf S -y|| + || / e -('-)[^( s )_ W5 (t)]rf s || ;= J 1 + J 2 . 

./t/2 ./t/2 

One has: 

■A = 11^5(0 — y — ^<5(^) e ~^ 2 || - ► as t — > 00, 
because, as we prove below, 

Hm| — 2/|| = 0. (2.2) 

(5^0 

To prove that J 2 - ¥ as i — > 00, we estimate 

= jK^ + e^))- 1 ^) -e(i))(^ + e(*))- 1 ^V< y |! < ||/ 5 ||e- 2 (i)|e(0i(*-^), 
where t/2 < s < t, and £ is an intermediate point in the Lagrange formula. Thus, 

■h<\\f&\\ f e- {t - s) (t- s)dse- 2 (t) sup |e(f)| -> as t -> 00. 

A/2 

Let us prove (2.2). The element -u^ := ws(ts) is the minimizer of the problem: 
\\Aw — f$\\ 2 + e||w|| 2 = min, e := e(t), t := £5. Thus, 

||A^-M| 2 + e|K|| 2 < |Ky)-/ 5 || 2 + e||y|| 2 = o 2 + e||y|| 2 . 

So, I |w<5| I < ||y||, because of (1.4). Therefore, one may assume that w$ — W as <5 — > 0, 
and, as we prove below, W = y. Now, Lemma 1 implies that (2.2) holds. 

Let us prove that W = y. It follows from (1.4) that -81/7,5 — > A*/ as 5 — > 0. This and 
u>«5 — 1 14 7 , imply _BW = A*/, since -B is monotone and therefore w— closed. We prove 
w— closedness of B below. Since the minimal-norm solution to (1.2) is unique, and since 
\\W\\ < ||y||, it follows that W = y, as claimed. 

Finally, we prove w— closedness of a monotone, hemicontinuous operator B defined 
on all of H. We call an operator B w— closed if Wj — ^ y and Bwj — * / imply By = f. 
An operator B is called monotone, if (B(u) — B(v),u — v) > for all u,v G D(B), and 
hemicontinuous, if the function t 1— > (-B(ii + tt> ), 2) is continuous for any -a, i>, and z & H, 
as a function of t e [0, 1). To prove w— closedness of .B, we start with the relation: 
(B(uj) — B(y — tz),Uj — y + tz) > 0. Let j — > 00. Then (/ — B(y — tz),tz) > 0, or, 
since t > 0, (/ — S(y — iz), 2) > 0. Let t — > 0. Then, by hemicontinuity of 5, one gets 
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(/ — B(y), z) > 0. Since z is arbitrary, it follows that By = f, as claimed. Note, that if 
B is continuous, it is hemicontinuous. Step 2 is done. Theorem 1.1 is proved. □ 

Remark 2. Suppose that the assumption f$ _L N(A*) does not hold. Let fs = g + h, 
where g _L h, g G N(A*). Then one can use the discrepancy principle of the form: 

\\A(B + e(t))- 1 A*f s -f s \\ = CS, \\f s \\ > CS, C = const > 1. (1.4') 

In Step 1 we prove now that h(S,0) < C 2 5 2 , h(S, oo) > C 2 5 2 , and the arguments are 
similar to the given in the proof of Theorem 1.1. 

Remark 3. In this remark we prove a discrepancy principle for nonlinear, monotone, 
continuous operators, defined on all of H . 

Theorem 2.1. Assume: i) A is a monotone, continuous, defined on all of H , 
operator, ii) equation A(u) = f is solvable, y is its minimal-norm solution, and Hi) 
\\fs ~ /II < 11^4(0) — fs\\ > CS, where C > 1 is a constant which can be chosen 
arbitrarily close to 1. Define e(S) > to be the minimal solution to the equation 

\\A(u Ste )-f s \\=C6, (2.3) 

where us^ e is any element satisfying inequality 

F(u s , e ) <m+(C 2 - 1)5 2 , F := \\A(u) - f s \\ 2 + e\\u\\ 2 , 

and m = m(S,e) := inf u F(u). Then equation (2.3) for e has a solution e(S) > 0. If e(S) 
is its minimal solution, and u$ := us^s)> then lim^o H M <5 — y\ \ — 0. 

Proof. If A is monotone, continuous, defined on all of H, then the set Nf := {u : 
A(u) = /} is convex and closed, so it has a unique minimal-norm element y. To prove 
the existence of a solution to (2.3), we prove that the function h(5, e) := ||A(u,j )e ) — f$\\ is 
greater than C5 for sufficiently large e, and smaller than CiS for sufficiently small e and 
C\ > C arbitrarily close to C. Because of the continuity of h(5, e) with respect to e on 
(0, oo), equation h(5,e) = C5 has a solution if C > 1 and C < ||-A(0) — f$\\. 

Let us prove the above estimates. One has 

F(u s , e ) <m + (C 2 - l)5 2 < F(0) + (C 2 - 1)5 2 , 

and 

F(u s , e ) <m + {C 2 - 1)5 2 < F(y) + {C 2 - 1)5 2 = e\ \y\ \ 2 + C 2 5 2 . 

Therefore, as e — > oo, one gets \ \us, e \ \ < — ^ 0, where c > is a constant depending on 
5. Thus, by the continuity of A, one obtains lim^oo h(5, e) = ||A(0) — fs\\ > CS. 

Now, let e -> 0. Then h 2 (5, e) < e\\y\\ 2 +C 2 5 2 . Thus liminf e _ h(6, e) < CS. Therefore 
equation h(S, e) = C±S has a solution e(S) > if C < C\ < ||-A(0) — f$\\, which is what we 
want, because C\ > 1 can be taken arbitrarily close to 1 if C > 1 can be taken arbitrarily 
close to I. 

Let us now prove that if us :— us t€ (5), then lim^o \ \ u s — y\ \ = 0. From the estimate 
\\A(us)-fs\\ 2 + e\\u s \\ 2 <C 2 S 2 + e\\ y \\ 2 , 
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and from the equation (2.3), it follows that \\us\\ < ||y||. Thus, one may assume that 
u$ — ^ U, and from (2.3) it follows that A{u§) — > / as 5 — > 0. By u>— closedness of 
monotone continuous operators, one gets A(C/) = /, and from \\us\\ < ||y|| it follows 
that ||C/]| < ||y||. Because the minimal norm solution to the equation A(u) — f is 
unique, one gets U = y. Thus, us — 1 y, and ||w,5|| < By Lemma 1, it follows that 
lim^o — y\ \ = 0. Theorem 2.1 is proved. □. 
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